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Abstract 

We study the action of a finite group on the Riemann-Roch space 
of certain divisors on a curve. If G is a finite subgroup of the automor- 
phism group of a projective curve X over an algebraically closed field 
and D is a divisor on X left stable by G then we show the irreducible 
constituents of the natural representation of G on the Riemann-Roch 
space L(D) = Lx(D) are of dimension < d, where d is the size of the 
smallest G-orbit acting on X. We give an example to show that this 
is, in general, sharp (i.e., that dimension d irreducible constituents 
can occur). Connections with coding theory, in particular to permu- 
tation decoding of AG codes, are discussed in the last section. Many 
examples are included. 
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4.5 Permutation decoding application 



Let X be a smooth projective (irreducible) curve over an algebraically 
closed field F and let G be a finite subgroup of automorphisms of X over F . 
We often identify X with its set of F-rational points X(F). If D is a divisor 
of X which G leaves stable then G acts on the Riemann-Roch space L(D). 
We ask the question: which (modular) representations arise in this way? 

Similar questions have been investigated previously. For example, the 
action of G on the space of regular differentials, Q 1 (X) (which is isomorphic 
to L(K), where K is a canonical divisor). This was first looked at from the 
representation-theoretic point-of-view by Hurwitz (in the case G is cyclic) and 
Weil-Chevalley (in general). They were studying monodromy representations 
on compact Riemann surfaces. For more details and further references, see 
the book by Breuer jB] and the paper |MPj . Other related works, include 
those by Nakajima [N], Kani [Ka], Kock and Borne [EoT| . |Bo2] . |Bo3] . 

The motivation for our study lies in coding theory. The construction of 
AG codes uses the Riemann-Roch space L(D) associated to a divisor D of 
a curve X defined over a finite field |GJ. Typically X has no non-trivial 
automorphisms 1 , but when it does we may ask how this can be used to 
better understand AG codes constructed from X. If G is a finite group 
acting transitively on a basis of L(D) (admittedly an optimistic expectation, 
but one which gets the idea across) then one might expect that fast encoding 
and decoding algorithms exists for the associated AG codes. Of course, for 
such an application, one wants F to be finite (and not algebraically closed). 

1 Indeed, a theorem of Rauch, Popp, and Oort (see §1.2 in |Bo3| . for example) implies 
that if g > 3 then the singular points of the moduli space M g of curves of genus g 
correspond to curves having a non-trivial automorphism group. 
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These ideas are discussed in £0] below for AG codes constructed from the 
hyperelliptic curves y 2 = x p — x over GF(p). Several conjectures on the 
complexity of permutation decoding of the associated AG codes are given 
there. 

1 The action of G on L(D) 

Let A be a smooth projective curve over an algebraically closed field F. Let 
F(X) denote the function field of A (the field of rational functions on A) 
and, if D is any divisor on A then the Riemann-Roch space L(D) is a finite 
dimensional F- vector space given by 

L(D) = L X {D) = {fe F(A) X | div(f) + D>0}U {0}, 

where div(f) denotes the (principal) divisor of the function / G F(X). Let 
£(D) denote its dimension. We recall the Riemann-Roch theorem, 

£(D)-£{K-D)=deg(D) + l-g, 

where K denotes a canonical divisor and g the genus 2 . 
The action of Aut(A) on F(X) is defined by 

p: Aut(A) — ► Aut(F(A)), 
9 — > (f^f 9 ) 

where P(x) = (p(g)(f))(x) = f{g-\x)). 

Note that Y = X/G is also smooth and F(X) G = F(Y). 

Of course, Aut(A) also acts on the group Div(X) of divisors of A, de- 
noted g(52 P dpP) = J2 p d P g(P), for g G Aut(A), P a prime divisor, and 
dp G Z. It is easy to show that div(f 9 ) = g(div(f)). Because of this, if 
div(f) + D > then div(f 9 )+g(D) > 0, for all g G Aut(A). In particular, if 
the action of G C Aut(A) on A leaves D G Div(X) stable then G also acts 
on L(D). We denote this action by 

p : G -> Aut(L(£>)). 

2 We often also use g to denote an element of an automorphism group G. Hopefully, 
the context will make our meaning clear. 
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2 Examples and special cases 



Before tackling the general case, we study the Riemann-Roch representations 
of G when X = P 1 or D is the canonical divisor. 

2.1 The canonical embedding 

This case was solved by Weil and Chevalley - see the beautiful discussion in 
[MP], 

Let K denote a canonical divisor of X, so deg(K) = 2g—2 and dim(L(K)) = 
g. Let K g } denote a basis for L(K). If the genus g of X is at least 2 

then the morphism 

0:X ► P(Q X (X)) S P^ 1 

x i — >■ («x(a;) : ... : K g (x)) 

defines an embedding, the "canonical embedding" , and <fr is called the "canon- 
ical map". It is known that L(K) is isomorphic (as F-vector spaces) to the 
space Q l (X) of regular Weil differentials on X. This is contained in the space 
of all Weil differentials, Sl(X). (In the notation of jEH], ^(X) = ^(X)(0).) 
Since G acts on the set of places of F, it acts on the adele ring of F, hence 
on the space Q(X). 

Now, even though K might not be fixed by G, there is an action of G on 
L(K) obtained by pulling back the action of G on f2 x (X) via an isomorphism 
L(K) = ^(X). 

The group Aut(X) acts on X and on its image Y = 4>{X) under an 
embedding <fi : X — > P 71 . If arises from a very ample linear system then an 
automorphism of Y may be represented (via the linear system) by an element 
of PGL(n + 1, F) acting on P n which preserves Y. For instance, if D is any 
divisor with deg(D) > 2g then the morphism 

: X -> P"- 1 
x i > (fi(x) : ... : f n (x)) 

defines an embedding, where {fi, f n } is a basis for L(D) (see, for example, 
Stepanov [St], §4.4). This projective representation of G on L(D) exists 
independent of whether or not D is left stable by G. 

Example 1 Let X = F l /C have projective coordinates [x : y], let G — {1, g}, 
where g(x/y) = y/x, and let D = 2[1 : 0] — [0 : 1], so L(D) has basis 
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{x/y,x 2 /y 2 }. Then g(x/y) = (y/x) 3 (x 2 /y 2 ) andg(x 2 /y 2 ) = (y/xf(x/y). 
Thus, as an element of PGL(2,C) , g is 

Suppose, for example, X is non-hyperelliptic of genus > 3 and (f> arises 
from the canonical embedding. In this case, we have (a) the projective rep- 
resentation 

tt: Aut(P(fi 1 (X))) 

(acting on the canonical embeding of X) and (b) the projective representation 
obtained by composing the "natural" representation G — > Aut(Q 1 (X)) with 
the quotient map Aut(fi 1 (X)) -> Aut(fi 1 (X)/F x ) = Aut(P(fi 1 (X))). These 
two representations are the same. 

Remark 1 For further details on the representation G — > Aut(Q 1 (X)) , see 
for example, the Corollary to Theorem 2 in TR)/ . Theorem 2.3 in IMPJf . and 
the book by T. Breuer JB^ . 

2.2 The projective line 

Before tackling the general case, we study the Riemann-Roch representations 
of G when X = P 1 . 

Let X = P x /F, so Aut(X) = PGL(2, F), where F is algebraically closed. 
Let oo = [1 : 0] G X denote the element corresponding to the localization 
F[x]n/ X y In this case, the canonical divisor is given by K = — 2oo, so the 
Riemann-Roch theorem becomes 

£(D) - £(-2oo — D) — deg(D) + 1. 

It is known (and easy to show) that if deg(-D) < then £(D) = and if 
deg(£>) > then 1(D) = deg(D) + 1. 

In the case of the projective line, there is another way to see the action 
p of Aut(X) on F(X). Each function / e F(X) may be written uniquely as 
a rational function f(x) = p(x)/q(x), where p(x) and q(x) are polynomials 
that factor as the product of linear polynomials. Assume that both p and 
q are monic, and assume that the linear factors of them well. The 

group Aut(X) "acts" on the set of such functions / by permuting its zeros 
and poles according to the action of G on X. (We leave aside how G acts on 
the constants, so this "action" is not linear.) We call this the "permutation 
action", n : g i — > 7r(g)(f) = f g , where f g (x) denotes the function / with 
zeros and poles permuted by g. 
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Lemma 2 If G G Aut(X) leaves D G Div(X) stable then 



*(9)(f) = cp(g)(f), 



for some constant c. 

Proof: Note that, by definition, div(ir(g)(f)) = div(f g ) = g(div(f)), for g G 



G and / G L{D). Since dw(n(g)(f)) = g(div(f)) = dw(p(g)(f)) = div(P), 



the functions f 9 and / ff must differ by a constant factor. □ 

The above lemma is useful since it is easier to deal with 7r than p in this 
case. 

A basis for the Riemann-Roch space is explicitly known for P 1 . For no- 
tational simplicity, let 



Lemma 3 Let Pq = oo = [1 : 0] G X denote the point corresponding to 
the localization F[x]^y x y For 1 < i < s, let Pi — [pi : 1] denote the point 
corresponding to the localization F[x]^ Pi j, for pi G F. Let D = J2 s i=0 a>iPi 
be a divisor, G Z for < k < s. 

(a) If D is effective then 

{l,m P Xx) k | 1 < k < Oi,0 < i < s} 
is a basis for L(D). 

(b) If D is not effective but deg(D) > then write D = dP + D' , where 
deg(D') = 0, d > 0, and P is any point. Let q(x) G L(D') (which is a 
1- dimensional vector space) be any non-zero element. Then 



is a basis for L(D). 
(c) If deg(D) < then L(D) = {0}. 

The first part is Lemma 2.4 in [Lj. The other parts follow from the 
definitions and the Riemann-Roch theorem. 
In general, we have the following result. 




p = [l : 0] = oo 
P=[p:l]. 



{mp(x) l q(x) 



0<i<d} 
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Theorem 4 Let X, F, G C Aut(X) = PGL(2 ) F), and D = E;=o a ^ be 
a divisor as above. Let p : G — > Aut(L(D)) denote the associated represen- 
tation. This acts trivially on the constants (if any) in L(D); we denote this 
action by 1. Let S = supp(D) and let 

s = u s 2 u ... u s m 

be the decomposition of S into primitive G-sets. 

(a) If D is effective then 

where pi is a monomial representation on the subspace 

Vi = (m P (x)^ | 1 < tj < aj, P E S t ), 

satisfying dim(Vi) = Ylp-eS a v f or ^ — * — m ' Here (...) denotes the 
vector space span. 

(b) If deg(D) > but D is not effective then p is a subrepresentation of 
p : G — > Autp L(D'), where D' is a G-equivariant effective divisor 
satisfying D' > D. 

Proof: (a) Fix an i such that 1 < i < m. Consider the subspace Vi of 
L(D). Since G acts by permuting the points in Si transitively, this action 
induces an action p± on Vi. This action on Vi is a monomial representation, 
by Lemma 121 It is irreducible since the action on Si is transitive, by defi- 
nition. Clearly ©™!p m is a subrepresentation of p. For dimension reasons, 
this subrepresentation must be all of p, modulo the constants (the trivial 
representation). 

(b) Since D is not effective, we may write D = D + — D~ , where D + and 
D~ are non-zero effective divisors. The action of G must preserve D + and 
D~ . Since L(D) is a G-submodule of L(D + ), the claim follows. □ 

3 The general case 

Let X be a smooth projective curve defined over a field F. The following is 
our most general result. 
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Theorem 5 Suppose G C Aut(X) is a finite subgroup, and that the divisor 
D ^ on X is stable under G. Let do denote the size of a smallest G-orbit in 
X. Each irreducible composition factor of the representation of G on L(D) 
has dimension < do. 

Remark 2 This is best possible in the sense that irreducible subspaces of 
dimension do can occur, by Theorem^(see also and Example \S. 2. 1 below). 

Remark 3 If F has characteristic then every finite dimensional repre- 
sentation of a finite group is semi-simple (Prop 9, ch 6, ISef). If F has 
characteristic p and p does not divide \G\ then every finite dimensional rep- 
resentation of G is semi-simple (Maschke's Theorem, Thrm 3.14, ICR}/ , or 

Proof: Let D ^ be a effective G- invariant divisor of minimal degree do. 
Let d = [deg(D)/do] denote the integer part. The group G acts on each space 
in the composition series 

{0} = L(-(d + 1) A) + D) C L(-dD + D) C L(-(d - 1)D + D) C 
... C L(-(d - m)Do + D) C ... C L(D) . 

In particular, G acts on the successive quotient spaces 

L(-(d-m-l)D + D)/L(-(d-m)D + D), 0<m < d-1, 

by the quotient representation. These are all of dimension at most do (Prop. 
3, ch 8, [F]). 

□ 

Corollary 6 Suppose that G is a non-abelian group acting on a smooth pro- 
jective curve X defined over an algebraically closed field F and assume p does 
not divide the order of G. Let do be as in Theorem^ and let do denote the 
largest degree of all irreducible (F -modular) representations ofG. Then 

d > d G . 
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Proof: Construct an effective divisor D of X fixed by G. We may assume 
that its degree is so large that the formula of Borne [Bolj implies that each 
irreducible representations of G occurs at least once in the decomposition of 
L(D). Therefore the set of irreducible subrepresentations of L(D) are the 
same as the set of irreducible representations of G. The result now follows 
from our theorem. □ 

Remark 4 There are more general conditions for which do = do holds. For 
example, assume that P is a point in an orbit of size do and let H = Gp 
denote the stabilizer of P, so do = \G\/\H\. Let a denote an irreducible rep- 
resentation of H . If H is normal in G with cyclic quotient and if all the 
equivalence classes a 9 (g G G/H) are distinct then Ind^a is irreducible and 
of dimension do, by Clifford's theorem. If there is an irreducible representa- 
tion of G of this form Ind^a under the above conditions then d Q < d G . 

Question: Is there an analog of Corollary El for wildly ramified ir : X —>■ 

X/Gl 

3.1 Examples 

Example 7 Let ¥ be a separable algebraic closure o/F 3 . Let X denote the 
Fermat curve over F whose projective model is given by x A + y 4 + z 4 = 0. 
The point P = (1 : 1 : 1) 6 X(W) is fixed by the action of G = S3. 

Based on the Brauer character table of S3 over F 3 (available in GAP 
IGAPf ). the group G has no 2-dimensional irreducible (modular) representa- 
tions. Consequently, dc = do = 1. 

Example 8 Let k = C denote the complex field and let X(N) denote the 
modular curve associated to the principal congruence group T(N) (see for ex- 
ample Stepanov, ' t StJ, chapter 8). It is well-known that the group PSL(2, Z/NZ) 
is contained in the automorphism group of X(N). Let X = X(p), where 
p > 7 is a prime, and let G = PSL(2,¥ p ) . In this case, we have, in the 
notation of the above corollary, da = p + 1- (The representations of this 
simple group are described, for example, in Fulton and Harris IFHf 3 .) 

3 Actually those of SL(2,¥ p ) are described in |FH| . but it is easy to determine the 
representations of PSL(2,¥ p ) from those of SL(2,F p ). 
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3.2 y 2 = x p - x 

In general, if X is a curve defined over a field F with finite automorphism 
group G = Aut F (X) then we call G large if \G\ > \X(F)\. 

Lemma 9 If G is large then every point of X(F) is ramified for the covering 
X -> X/G. 

Proof: Suppose P G X(F) is not ramified, so the stabilizer of P, Gp, is 
trivial. In this case, \G - P\ = \G\/\G P \ = \G\. But G ■ P C X(F) so 
\G ■ P\ < \X(F)\, a contradiction. □ 



3.2.1 Case F = GF(p) 

Let p > 3 be a prime, F = GF(p), and let X denote the curve defined by 

y 2 = x p — x. 

This has genus We assume that the automorphism group G = Awti?(X) 
is a central 2-fold cover of PSL(2,p), we have a short exact sequence, 

1 —> Z —> G —> PSL 2 (p) -> 1, (3.1) 

where Z denotes the center of G (Z is generated by the hyperelliptic involu- 
tion). The following transformations are elements of G: 



/ >"' | i / >"» | / >"» | i /"l 2 ,-y» 

i — >■ x + 1, f x\ — y—l/x, °' 

3+1 

2 



1 y 1 — >v, [ y 1 — > y/x - 



where a G F x is a primitive (p — 1) — st root of unity. This group acts 
transitively on X(F), so it has an orbit of size do = \X(F)\ = p + 1. 

Let Pi = (1 : : 1) and let H be its stabilizer in G. A counting argument 
shows that H is a solvable group of order 2p(p — 1) generated by 71, 72(a) 
and 73. By Lemma El every point in 

X(F) = {(1 : : 0), (0 : : 1), (1:0: 1), (p - 1 : : 1)} 

is ramified over the covering X — > X/G in the sense that each stabilizer 
G P = Stab G (P) is non-trivial, PgI(F). 
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It is known (Proposition VI. 4.1, jStij ) that, for each m > 1, the Riemann- 
Roch space of D = mP\ has a basis consisting of monomials, 



x l y J , 



< i < p — 1, j > 0, 2i + pj < m. 



Lemma 10 The semisimplification p ss of the representation p of H acting 
on L(D) is the direct sum of one-dimensional representations of G. 

Proof: The generator 71 acts trivially on the basis of L(D), whereas 

/ 1 \ 



72(a) 



and 



/ 1 \ 

x 

\ x r y s J 



2 

ax 



a 2r+s x r y s J 



( 1 

a 2 
\0 ... 



° W 1 \ 

X 



a 





2r+s 



\ x r y s J 



73 



/ 1 \ 



X 



\ x r y s J 



t 



\ /I ... 0\ / 1 \ 



x + 1 
\(x + 1) V J 



1 1 



\ ... r 1 / 



where the non-zero terms in bottom row of the matrix representation of 
73 are in the last r + 1 row entries and consist of the binomial coefficients 
(r- 'j)\jv — J ' — r - Therefore, the group generated by these matrices is 
lower-triangular, hence solvable. □ 



3.2.2 Case F = GF(p 2 ) 

Let F = GF(p 2 ) and let F = GF(p). 

The automorphism group G = Autp{X) is a central 2-fold cover of 
PGL(2,p) andwe have a short exact sequence, 



1 -> Z -> G A PGL 2 {p) -> 1, (3.3) 

where Z denotes the subgroup of G generated by the hyperelliptic involution 
(which coincides with the center of G), by Gob jO]. The group G has order 
2|PGL(2,p)| = 2p(p 2 — 1). The following transformations generate G: 
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X H 


— > X, 


y 






♦ x + 1 




— ► 2/, 



7i = 1 „. , , „. > 72 = 72W 



.r 



x i — ► a 2 x, 



y 1 — ► ay, 

x i — ► —1/x, 



73 = i j 74 = S i E+1 

where a G F x is a primitive 2(p — 1) — st root of unity. 

Proposition 11 Let p > 3 be a prime. 

(a) Case p = 3 (mod 4): 

Let Pi = (1 : : 1) and fix some P 2 G - X(F ). The set of 

rational points X(F) decomposes into a disjoint union 

d = X(F ) = G ■ Pi, C 2 = X(P) - X(F Q ) =G-P 2 , 
with \Ci\ = p + 1 and \C 2 \ = 2p(p — 1). 

(b) Case p = 1 (mod 4): 

T/ie automorphism group of X/F acts transitively on X(F) and the 
stabilizer of any point is a group of order 2p(p — 1). 

Remark 5 The proof of this proposition is omitted, so may be regarded as a 
conjecture instead, if the reader wishes. It has been verified using MAGMA 
if p = 5, 7, 11, 13. It has been proven in an email to the first author by Bob 
Guralnick. 

This and Lemma El imply every point in X(F) is ramified for the covering 
X -> X/G 

Let Pi = (1 : : 1) and let Hi be its stabilizer in G. We have already 
seen that Hi is a solvable group of order 2p{p — 1) generated by 71, 72(a), 
and 73. As a consequence, \C\\ = \G ■ Pi| = |G|/|ifi| —p+1 

Using Hi = (71,72,73) and the explicit expressions for the 7^ it can 
be checked directly that no g 6 Hi, g ^ 1, fixes any P E C 2 - Therefore, 

PinP 2 = {i}. 

According to the proposition, the stabilizer H 2 of P2 has order p+1. This 
and \G\ = \Hi\ ■ \H 2 \ implies G = Hi-H 2 . In other words, H 2 is a complement 
of Hi in G. (As sets, G/H x = PGL 2 (p)/B ^ ¥ 1 (F ).) 
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In fact, if B denotes the (Borel) upper-triangular subgroup of PGL(2,p) 
then Hi = t~ 1 (B). Since B is solvable and any abelian cover of a solvable 
group is solvable, H\ is solvable. Since B is not normal in PGL2Q9), H\ is 
not normal in G. 

By the proposition, the divisor D 2 associated to O2 has degree 2p(— 1) > 
2g, so by the Riemann-Roch theorem, dim(L(P 2 )) = 2p(p — 1) + 1 — 
The theorem implies that, in this case, the largest irreducible constituent of 
L(D2) is dimension = p. 

4 Applications 

In this section we discuss connections with the theory of error-correcting 
codes. 

Throughout this section, we assume X, G, and D are as in Theorem 
Assume F is finite. 

Let Pi, P n G X(P) be distinct points and E = Px+...+P n G Div(X) be 
stabilized by G. This implies that G acts on the set supp(E) by permutation. 
Assume supp(P) n supp(P) = 0. Let C = C(D, E) denote the AG code 



The group G acts on C by g G G sending c = (/(Pi), /(P n )) G C to c' = 
{f{g' l {Pi)),...J(g' 1 {P n ))) 1 where / G £(£>). First, we observe that this 
map, denoted 4>(g), is well-defined. In other words, if evalE is not injective 
and c is also represented by /' G L(D), so c = (/'(Pi), f'(P n )) G C, then 



we can easily verify (/GrH^i)), -, /GT 1 ^*))) = (/' (ff -1 W). - , f\9~\ P n))) 



(Indeed, G acts on the set supp(E) by permutation.) This map 0(g) induces 
a homomorphism of G into the permutation automorphism group of the code 
Aut(C), denoted 




(4.1) 



/ 



eval E : L(D) -> P n , 
• M/(/',) /(/'„!!. 



(4.2) 



4> : G -> Aut(G) 



(4.3) 
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(Prop. VII. 3. 3, |Stij . and §10.3, page 251, of StJ) 4 . The paper Wesemeyer 
[W] investigated <fi when C is a one-point AG code arising from a certain 
family of planar curves. 

4.1 Separation of points 

To investigate the kernel of this map <f), we introduce the following notion. 
Let H G Div(X) be any divisor. We say that the space L(H) separates 
points if for all points P,Q G X, f(P) = f(Q) (for all / G L(H)) implies 
P = Q (see jH], chapter II, §7). 

We shall show that Riemann-Roch spaces separate points for "big enough" 
divisors. 

If G is a group of automorphisms of X defined over F then G induces 
an automorphism on the image of the evaluation map evalE '■ L(D) — > F n . 
For this discussion, let us assume this is an injection. (This is not a serious 
assumption.) To understand the kernel of this map in (J4.3|) . we'd like 
to know whether or not (/(Pi), f(P n )) = (fig' 1 Pi), f{g' 1 P n )) implies 
Pi = g~ x Pi, for 1 < % < n. 

Let X be a plane curve with irreducible equation 

y n + hW 1 + ■■■ + k-Mv + /„(*) = o, 

where deg(/j(:r)) < i, 1 < i < n. We assume n > 2 but we do not assume X 
is non-singular. 

Let D be a divisor on X and let (x)oo be the point divisor of x, so 

deg(x)oo = n. 

Recall that the Riemann-Roch space L(D) separates points if, for each 
pair P, Q G X - supp(D), f(P) = f(Q) for all / G L(D) implies P = Q \R. 

Lemma 12 // (x)^ < D then L(D) separates points. 

The hypothesis cannot be omitted. 
Proof: Note that if D' < D and L(D') separates points then L(D) does too. 

By hypothesis, L((x)oo) C L(D). By Proposition III. 10. 5 in |Stij . x l yi G 
L{{x)oo), for < j < n — 1 and < i < 1 — j. (Here < i < 1 — j means 
i = when j > 1.) Let P 1 = (xi,yx) and P 2 = (a^,?^)- The condition 

4 Both of these references define <f> by 4>{g)(c) = (f{g{Pi j), f(g(P n ))). However, this 
is a homomorphism only when G is abelian. 
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/(Pi) = /(-P2); for & 11 / £ -L((x)oo) implies x^i = x^iL f° r a H as above. 
In particular, we may take = (1,0) and (i,j) = (0,1), so Pi = P 2 . 

Therefore, L((a;) 00 ) separates points, and hence L(D) does too. □ 

As the following example shows, the lemma is in some sense best possible. 

Example: Let F = GF(9) and X be the curve defined over F by 

2 3 
y — x — x. 

Let Pqo be the point at infinity on X . The spaces L(mPoo), 1 < m < 2, do not 
separate points on X. Indeed, there are distinct points P, Q G X(F) which 
have the same x-coordinate. Since L(2P OQ ) = (l,x), it cannot distinguish 
them. On the other hand, by the Lemma, L(3Poo) must separate points. 
Indeed, L(3P»o) = (1, x, y), so from the reasoning in the above proof, it is 
obvious that it does. 

As a consequence of the lemma (changing variables if necessary), we see 
that, if for some a G P, (x — a)^ < D then L(D) separates points. 

Question: Is the converse also true? 

4.2 The kernel of (f> 

The paper by Wesemeyer jWj investigated the homomorphism <p : G — > 
Aut(C) in some special cases. In general, if L(D) separates points then 

Ker(0) = {geG\ g{Pi) = P, 1 < % < n}. 

It is known (proof of Prop. VII3.3, |Stij ) that if n > 2g + 2 then {g G 
G I g{Pi) = Pi, 1 < i < n} is trivial. Therefore, if n > 2g + 2 and L(D) 
separates points then is injective. 

Example 13 Let F = GF(7) and let X denote the curve defined by 

2 7 
y = x — x. 

This has genus 3. The automorphism group Autp(X) is a central 2- fold cover 
of PSL 2 (F) : we have a short exact sequence, 

1 -> H -> Autp(X) -> PSL 2 (7) -> 1, 

where H denotes the subgroup of Aut F (X) generated by the hyperelliptic invo- 
lution (which happens to also be the center of Autp(X) ). ( Over the algebraic 



15 



closure F, Autp(X) / center = PGL 2 (F), by IG], Theorem 1.) Generators 
for the automorphism group are given in \3. jjj) above, taking p = 7. 
There are 8 F -rational points^: 

X(F) = {Pi = (1 : : 0),P 2 = (0 : : 1),P 3 = (1:0:1), ..,P 8 = (6:0: 1)}. 

T/ie automorphism group acts transitively on X(F). Consider the projection 
C —>■ P 1 defined by <f)(x,y) = x. The map <fr is ramified at every point in 
X(F) and at no others. 

Let G = Stab(Pi, Autp(X)) denote the stabilizer of the point at infinity 
in X(F). All the stabilizers Stab(Pi, Autp(X)) are conjugate to each other 
in Autp{X), 1 < % < 8. The group G is a non-abelian group of order 42 
(In fact, the group G/Z(G) is the non-abelian group of order 21, where Z(G) 
denotes the center of G.) 

It is known (Proposition VI. 4-1, IStif ) that, for eachm > 1, the Riemann- 
Roch space L(mPi) has a basis consisting of monomials, 

iV, < i < 6, j > 0, 2i + 7j < m. 
Let P = 5P 1; S = C(F) - {Pi}, and let 

C(D,S) = {(f(P 2 ),...J(P 8 )) \feL(D)}. 

This is a [7,3,5] code over F. In fact, dim(L(P)) = 3, so the evaluation 
map f i — > (/(P 2 ), /(Pg)) ; / G L(D), is injective. Since G fixes D and 
preserves S , it acts on C via 

g : (/(P 2 ), /(P 8 )) ,— > (f(g- 1 P 2 ), fig-'Ps)), 

for g G G. 

Let P denote the permutation group of this code. It a group of order 
42. However, it is not isomorphic to G. In fact, P has trivial center. The 
(permutation) action of G on this code implies that there is a homomorphism 

iP:G^P. 

What is the kernel of this map? There are two possibilities: either a subgroup 
of order 6 or a subgroup of order 21 (this is obtained by matching possible 

5 MAGMA views the curve as embedded in a weighted projective space, with weights 
1, 4, and 1, in which the point at infinity is nonsingular. 
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orders of quotients G/N with possible orders of subgroups of P). Take the 
automorphisms j\, 72 with a = 2 and 73. If we identify S = {P 2 , Ps} with 
{1,2, ...,7} then 

7 i-(2,7)(3,6)(4,5)=^, 

72 <-(2, 5, 3) (4, 6, 7) = g 2 , 

73 <-(l,2, ...7) =g 3 . 

The group ker{<p) = N = (g 2 ,g3) is a non-abelian normal subgroup of G = 
(91,92,93) of order 21. 

4.3 Permutation representations 

In this subsection, we show how theorems about AG codes can, in some cases, 
give theorems about representations on Riemann-Roch spaces. 

Assume that X/F is a hyperelliptic curve defined over a finite field F of 
characteristic p > 2 with automorphism group G = Autf(X). Let D be 
a G-equivariant divisor on X, let O C X(¥) be a G-orbit disjoint from the 
support of D, and let E = Ylp^o ^ • -^ e ^ P ^ e ^ ne permutation automorphism 
group of the code C = C(D, E) defined in (j4.1|) . 

Theorem 4.6 in |Wj implies that if n = deg(E) and t = deg(D) satisfy 
n > max(2t, 2g + 2) then the map (j) : G — > P is an isomorphism. Using 
this, we regard C as a G-module. In particular, the (bijective) evaluation 
map evalE '■ L(D) — > C in (|4.2j) is G-equivariant. Since G acts (via its 
isomorphism with P) as a permutation on G, we have proven the following 
result. 

Proposition 14 Under the conditions above, the representation p of G on 
L(D) is equivalent to a representation p' with with property that, for all 
g G G, p'(g) is a permutation matrix. 

4.4 Memory application 

If G is an linear code with non-trivial permutation group then this extra 
symmetry of the code may be useful in practice. In order to store the elements 
of G, we need only store one element in each G-orbit, so this symmetry can 
be used to more efficiently store codewords in memory on a computer. 
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Example 15 Let G = S3 act on the genus 3 Fermat quartic X whose pro- 
jective model is x A + y A + z 4 = over F 9 = F 3 (i), where i is a root of the 
irreducible polynomial x 2 + 1 G ^[a;]. One can check that there are exactly 
6 distinct points in the G-orbit of [a : 1 : 0] G X(Wg), where a is a generator 
o/F 9 x . Let 

G-[a:l:0] = {Q 1 ,...,Q 6 }, 
E = Q l + ... + Q 6 G Div(X), D = 6 • [1 : 1 : 1] G Dzu(X). 

T/ien -^(-D) 4- dimensional, by the Riemann-Roch theorem. Note that no 
Qi belongs to the support of D, so we may construct the Goppa code 

C = {(f(Q 1 ),...J(Q 6 )) I / G L{D)}, 

a generator matrix being given by the 4x6 matrix M = (/i(Q7))i<»<4,i<j<6; 
where /i,...,/4 are a basis of L(D). According to IMAGM AL dim^ 9 {C) = 4 
and the minimum distance of C is 2. The action of an element in the group 
G on C permutes the Qi, hence may be realized by permuting the coordinates 
of each codeword in C in the obvious way. (In other words, the action of G 
on C is isomorphic to the regular representation of S3 on itself.) Using the 
group action, storing all \C\ = 9 4 elements may be reduced to storing only 
the representatives of each orbit C/S 3 . 

4.5 Permutation decoding application 

If C is an linear code with non-trivial permutation group then this extra 
symmetry of the code may be useful in decoding. Permutation decoding is 
discussed, for example, in Huffman and Pless |HPj . We recall briefly, for the 
convenience of the reader, the main ideas. 

We shall assume that C is in standard form. Let C be a [n, k, d] linear 
code over GF(q), let t — [(d— 1)/2], and let G = (Ik, A) denote the generator 
matrix in standard form. From this matrix G, it is well-known and easy to 
show that one can compute an encoder E : GF(q) k — > GF(q) n with image 
C, and a parity check matrix H = (B, I n -k) in standard form, B = —A 1 . 

The key lemma is the following result: Suppose v = c + e, where c G C 
and e G GF(q) n is an error vector with Hamming weight wt(e) < t. Under 
the above conditions, the information symbols of v are correct if and only if 
wt(Hv) < t. 

Let P denote the permutation automorphism group of C. The permuta- 
tion algorithm is: 
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1. For each p e P, compute wt{H{pv)) until one with wt{H{pv)) < t is 
found (if none is found, the algorithm fails). 

2. Extract the information symbols from and use P to compute code- 
word c p from them. 

3. Return p~ l c p = Decode(t> ). 

For example, if P acts transitively then permutation decoding will correct at 
least one error. 

The key problem is to find a set of permutations in P which moves the 
non-zero positions in every possible error vector of weight < t out of the 
information positions. (This set, called a PD-set, will be used in step 1 
above instead of the entire set P.) 

Example 16 We give two examples of MDS codes for which permutation 
decoding applies. 

1. This is an example of a [7, 3, 5] one-point AG code over GF{7) arising 
from the hyperelliptic curve y 2 = x 5 — x. 

p:=7; 
F:=GF(p); 

P<x>:=PolynomialRing(F) ; 
f :=x~p-x; 

X:=HyperellipticCurve(f ) ; 

Div := DivisorGroup(X) ; 

Pls:=Places(X,l) ; 

S: = [Pls[i] : i in [2. .#Pls]] ; 

m:=4; 

D := m* (Div! Pis [1]) ; 

AGC := AlgebraicGeometricCode(S, D) ; 

Length (AGC) ; 

Dimension(AGC) ; 

MinimumDistance (AGC) ; 

WeightDistribution(AGC) ; 

PG := PermutationGroup(AGC) ; Identif yGroup(PG) ; 
ZP:=Center(PG) ; Identif yGroup(PG/ZP) ; 
IsTransitive(PG) ; 
GeneratorMatrix(AGC) ; 



19 



This code has generator matrix in standard form given by 

/ 1 2 5 1 5 \ 
G= 1 1 5 5 2 . 
\ 1 5 5 2 1 / 

Moreover, the permutation automorphism group of the code is a group 
of order 42 generated by 

S = {(1, 7)(2, 6)(3, 4), (1, 4, 5)(2, 6, 3), (1, 3)(2, 4)(5, 6)}. 

The elements of S U S ■ S can be used as a PD-set, where S ■ S = 
{sis 2 I Si e S}. 

2. This is an example of a [13, 5, 9] one-point AG code over GF (13) arising 
from the hyperelliptic curve y 2 = x 13 — x. Similar MAGMA commands, 
but with p = 13, yields that his code has generator matrix in standard 
form given by 
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Moreover, the permutation group is generated by 

{pi = (l,2)(3,8)(4,12)(5,7)(6,9)(10,ll), 
p 2 = (2,3,4,5,6,7,8,9,10,11,12,13)}. 

We shall show that P — {1} can be chosen to be a PD-set for < 4 er- 
rors. The argument proceeds on a case-by-case basis. One of the worst 
cases is when there are errors in positions 1, 2, 12 and 13. In this case, 
apply (reading right-to-left) p\PiP\p\- This pushes the error from posi- 
tions (1, 2, 12, 13) to (8, 11, 13, 6), in particular out of the information 
positions 6 . 

6 Additionally, this algorithm will, in some cases, work even if there are 5 errors (e.g., in 
positions 1, 2, 3, 4, 5). Because d — 9, with 5 errors we cannot be sure that the permutation 
decoded vector is the one which was sent. 
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Conjecture 17 For one-point AG codes C associated to y 2 = x p — x over 
GF(p) of length n = p, permutation decoding always applies. Its complexity 
is at worst the size of the permutation group of C , which we conjecture to be 
0(p 2 ) = 0(g 2 ) = 0(n 2 ). 

This matches the complexity of some known algorithms. 

Conjecture 18 For one-point AG codes C associated to y 2 = x p — x over 
GF{p 2 ) of length n = 2p{p — 1) + p, permutation decoding always applies 
and is more efficient in terms of computational complexity that the standard 
decoding algorithm in We conjecture that, if the points in X(F) are 

arranged suitably then the image of the Autp(X) in the permutation group 
of C may be used as a PD-set. Its complexity is at worst the size of the 
automorphism group of X, which is 0(p 2 ) = 0(g 2 ) = 0(n). 

If true, to our knowledge, this beats the complexity of other decoding 
algorithms, such as those in |Stij . 

Example 19 We give examples of two AG codes for which permutation de- 
coding probably applies. 

• This is an example of a [91, 5, 66] code constructed from the trace of 
a [91,3,87] one-point AG code over F = GF(49) arising from the hy- 
perelliptic curve y 2 = x 7 — x. (We use the trace code only because 
MAGMA version 2.10 cannot compute the permutation group of a code 
over GF(49).j 

p:=7; 

F:=GF(p-2); 

P<x> : =PolynomialRing(F) ; 
f :=x~p-x; 

X:=HyperellipticCurve(f ) ; 

Div := DivisorGroup(X) ; 

Pls:=Places(X,l) ; 

S: = [Pls[i] : i in [2..#Pls]]; 

m:=4; 

D := m* (Div! Pis [1]) ; 

AGC := AlgebraicGeometricCode(S, D) ; 

Length (AGC) ; 
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Dimension (AGC) ; 
MinimumDistance (AGC) ; 
WeightDistribution(AGC) ; 
AGCO : =Trace (AGC , GF (p) ) ; 
Length (AGCO) ; 
Dimension (AGCO) ; 
MinimumDistance (AGCO) ; 
WeightDistribution(AGCO) ; 
PG := PermutationGroup(AGCO) ; 
#PG; 

ZP:=Center(PG) ; 
#ZP; 

IsTransitive (PG) ; 
GeneratorMatrix(AGCO) ; 

The permutation group of the trace of the AG code is huge: 1073852196 
elements. The automorphism group G = Autp{X), which has 672 ele- 
ments, of the curve acts on X(F) with only two orbits, 0\ = X(GF(7)) 
of size 8 and O2 = X(F) — 0\ of size 84. (This follows from Propo- 
sition^^ but was verified using MAGMA in this case.) Of course, in 
a practical application, one would want to index the points of X(F) so 
that the information positions are contained in O2. 

• Let E denote the sum of all the points in O2 and let D be the sum of all 
the points in 0\. Note E has degree 84 ; D degree 8 ; and X has genus 
3. Therefore, by Theorem 4-6 in fT^ /. the permutation automorphism 
group P of the AG code C = C(D, E) satisfies P = G. In other words, 
the map (f) in is injective ( which also follows from the discussion 
above) and surjective. 
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